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(54) Arrangement and method for inspection of surface quality 



(57) The invention relates to a method for automatic 
inspection of the surface 20 of a moving object, in which 
a region on the object's surface is illuminated from at 
least two different illumination directions 1 3-1 5. The ob- 
ject's illuminated surface region is imaged with a camera 
to provide image information for analysis. The light 
sources in the different illumination directions 1 3-1 5 are 
pulsed to illuminate the object's surface region at differ- 
ent times, the pulsing frequency being >1kHz. The ob- 
ject's illuminated surface region is imaged as lines with 
a line scan camera 21 in sync with the above pulsing. 
The invention also relates to an arrangement for in- 
specting the surface 20 of a moving object, the arrange- 
ment comprising at least two light sources 10-12 in at 
least two different illumination directions 13-15 for illu- 
minating the surface region of the object under inspec- 
tion; a camera for imaging the object's surface region; 
and an image analyzer for analyzing the image informa- 
tion acquired from the object's surface 20 by imaging. 
The light sources 10-12 illuminate the object's surface 
20 from the different illumination directions 1 3-1 5 at dif- 
ferent times, and the camera is a line scan camera 21 . 
The arrangement further comprises a timing controller 
18 for synchronous pulsing of the light sources 10-12 
and the at least one line scan camera 21, the pulsing 
frequency of the light sources 1 0-1 2 being >1 kHz. 
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Description 

FIELD OF INVENTION 

[0001] The invention relates to inspection of strip-like 
or sheet-like surfaces, such as surfaces of rolled metal 
products, by an optoelectronic measuring arrangement. 

BACKGROUND OF INVENTION 

[0002] DE 19 511 534 A1 teaches a prior art method 
and arrangement in which the 3D characteristics of a 
moving surface are inspected by illuminating the surface 
from at least two different illumination directions with 
light sources, the light sources of each illumination di- 
rection illuminating the surface with a light of a different 
color than the other illumination directions. The object's 
surface is illuminated simultaneously from the different 
illumination directions, and the so illuminated surface is 
imaged with a camera to provide image information for 
analysis. The analysis of the 3D characteristics of the 
object's surface is based on color classification, with 
which the color values detected on the surface are com- 
pared. 

[0003] The prior art method and arrangement allow 
the inspection of the 3D characteristics of the object's 
surface but not of the glossiness and reflectivity of the 
surface, since symmetrical dark field illumination from 
two illumination directions is used in the method. The 
fact that the 3D analysis is based on color classification 
impairs the method: for example, the method is not able 
to adjust to a change in the surface material of the ob- 
ject's surface, in which the surface material changes ei- 
ther completely or changes to a different variety of the 
same surface material or both, and neither is it able to 
adjust to changes in the illumination. This causes false 
alarms, which poses a major problem particularly in pro- 
duction processes. 

[0004] On account of the above, the prior art method 
thus has a very limited ability to differentiate between 
different anomalies on the object's surface. 

BRIEF DESCRIPTION OF INVENTION 

[0005] The object of the invention is to provide a meth- 
od and an arrangement implementing the method, si- 
multaneously solving the above problems. The object is 
achieved with a method of the invention for automatic 
inspection of the surface of a moving object, the method 
comprising the steps of illuminating a region on the ob- 
ject's surface with light sources from different illumina- 
tion directions, and imaging the object's illuminated sur- 
face region with a camera to provide image information 
for analysis. The light sources in the different illumina- 
tion directions are pulsed to illuminate the object's sur- 
face region at different times, the pulsing frequency be- 
ing >1kHz. Further, the object's illuminated surface re- 
gion is imaged as lines with a line scan camera in sync 



with the above pulsing. If colors are not considered rel- 
evant, the line scan camera used can be a monochrome 
camera. If colors are also to be measured, the line scan 
camera used is a color camera. 

5 [0006] The invention also relates to an arrangement 
for inspecting the surface of a moving object, the ar- 
rangement comprising at least two light sources in at 
least two different illumination directions, i.e. at least one 
light source in each illumination direction used, for illu- 

10 minating a surface region of the object under inspection; 
a camera for imaging the object's surface region; and 
an image analyzer for analyzing the image information 
acquired from the object's surface by imaging. As re- 
gards the light sources, the arrangement comprises light 

15 sources that illuminate the object's surface at different 
times from different illumination directions. To take im- 
ages from the surface, the arrangement comprises at 
least one line scan camera. The arrangement also com- 
prises a timing controller for synchronous pulsing of the 

20 light sources and the at least one line scan camera, the 
pulsing frequency being >1kHz. 

[0007] The preferred embodiments of the invention 

are claimed in the dependent claims. 

[0008] The invention is based on the idea that the light 

25 sources in the different illumination directions are pulsed 
to illuminate the object's surface region at different 
times, the pulsing frequency being >1 kHz, and that the 
object's illuminated surface region is imaged as lines 
with a line scan camera in sync with the pulsing. 

30 [0009] Various advantages are achieved with the 
method and arrangement of the invention. The invention 
allows image analysis, in which the object's surface re- 
gion, imaged while illuminated at different times with 
light beams from different illumination directions, is in- 

35 spected. This enhances the analysis of the 3D charac- 
teristics of the surface considerably, since the object's 
surface region imaged while illuminated at different 
times with light beams from different illumination direc- 
tions reveals more of its 3D characteristics than when it 

40 is illuminated simultaneously from different illumination 
directions. In addition to enhancing the analysis of the 
3D characteristics, the non-simultaneous illumination 
also enhances inspection of the glossiness and reflec- 
tivity of the surface. The invention also allows the in- 

45 spection of the surface of a fast moving object, since the 
invention comprises fast synchronous pulsing of the 
light sources and the line scan camera. 
[0010] The preferred embodiments of the invention 
and other implementations described in detail empha- 

50 size the advantages of the basic invention and also bring 
about other advantages. The surface inspection shows 
the colors correctly, which renders the 3D analysis, 
glossiness analysis and reflectivity analysis of the sur- 
face more accurate. When the accuracy is improved, for 

55 example, false alarms are avoided, which greatly 
speeds up the production process. Further, a preferred 
embodiment of the invention introduces an improved 
way of inspecting a moving surface from a distance, for 
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example a hot moving surface. The surface inspection 
from a distance here means that the surface is inspected 
from a distance of at least one meter, perhaps even of 
three meters. 

BRIEF DESCRIPTION OF FIGURES 

[0011] In the following the invention will be described 
in greater detail by means of preferred embodiments 
and with reference to the attached drawings, in which 

Fig. 1 shows an arrangement with one line scan 
camera; 

Fig. 2 illustrates how orthogonally incident light ree- 
mitted from the object's surface behaves on differ- 
ent surfaces; 

Fig. 3 shows an arrangement with one line scan 
camera and timing controller; 
Fig. 4 is a schematic presentation of the operation 
of the line scan camera; 

Fig. 5 is a pulsing scheme for the light sources of 
three illumination directions and an output signal of 
the line scan camera; 

Fig. 6 shows the structure of a channel separator; 
Fig. 7 shows the structure of an image analyzer; 
Fig. 8 illustrates channel comparison for the calcu- 
lation of different characteristics of a surface region; 
Fig. 9a shows the spectrum of the wavelength 
range of visible light; 

Fig. 9b shows the spectra of the wavelength ranges 
of combined sources; 

Fig. 1 0 shows an arrangement in which the surface 

under inspection is dark-field illuminated at different 

times from two different directions; and 

Fig. 11 shows an arrangement with four line scan 

cameras. 

Fig. 12 shows an arrangement for inspecting the 
surface of a moving object using pulsed illumination 
and an area scan camera. 

DETAILED DESCRIPTION OF INVENTION 

[001 2] Fig. 1 shows an arrangement for inspecting the 
quality of a surface 20 of a moving object. The move- 
ment of the object is indicated by arrow A. In a preferred 
embodiment, the surface inspected is a strip-like sur- 
face or a sheet-like surface, for example a surface of a 
rolled metal product. The arrangement comprises light 
sources 10-12 of at least two - in the figure, three -illu- 
mination directions 13-15 for illuminating a region on the 
object's surface, and a line scan camera 21 for imaging 
the illuminated surface region. The arrangement further 
comprises a channel separator 16 for performing chan- 
nel separation on the output signal of the line scan cam- 
era 21 , and a image analyzer 1 7 for analyzing the image 
information obtained from the channel separator. 
[0013] In Fig. 1 the surface 20 of the moving object is 
illuminated with light sources 10-12 of at least two dif- 



ferent illumination directions 13-15. The illuminated re- 
gion on the object's surface is imaged with the line scan 
camera 21 , and the output signal acquired from the line 
scan camera 21 is subjected to channel separation in 

5 the channel separator 1 6. On the basis of the image in- 
formation contained in the channel-separated channels 
CH1, CH2, etc. an image analysis is performed in the 
image analyzer 17 to inspect the object's surface 20. 
[0014] Fig. 2 shows basic examples illustrating the 

10 physical behavior of light on a surface, which helps to 
understand the present invention. The different items of 
the figure show how orthogonally incident light 37 ree- 
mitted from the object's surface behaves on different 
surfaces. Fig. 2a shows the scattering of light reemitted 

15 from the objects' surfaces 40-41 . The reflectivity of sur- 
face 40 is poorer than that of surface 41 , wherefore the 
light reemitted 30 from surface 40 scatters more than 
the light reemitted 31 from surface 41. Another differ- 
ence is that the amount of light 30 reemitted from sur- 

20 face 40 is smaller than the amount of light reemitted 
31 from surface 41 . 

[0015] Fig. 2b shows the configuration of light 32-33 
reemitted from surfaces 42-43, which have different 
glossiness characteristics. The beam of light 32 reemit- 

25 ted from the surface 42 with poor glossiness is wider 
than the beam of light 33 reemitted from the surface 43 
with better glossiness. The amounts of reemitted light 
32-33 are here approximately equal. 
[0016] Fig. 2c shows light 34-35 reemitted from sur- 

30 faces 44-45, surface 44 being smooth and surface 45 
being uneven 46. The uneven surface 45 makes the 
light 35 reemitted from the surface incline. The amounts 
of light 34-35 reemitted from the surfaces 44-45 are 
equal. 

35 [0017] Fig. 3 shows an arrangement for inspecting the 
quality of the surface 20 of a moving object, the arrange- 
ment comprising light sources 10-12 of different illumi- 
nation directions 13-15 for illuminating a region on the 
object's surface so that each illumination direction used 

40 has at least one light source; focusing means 22-24 for 
focusing the illumination; a line scan camera 21 for im- 
aging the object's illuminated surface region; a channel 
separator 16; an image analyzer 17; and a timing con- 
troller 18 for synchronizing the operation of the above- 

45 mentioned components of the arrangement. The move- 
ment of the object is indicated by arrow A. If colors are 
irrelevant, the line scan camera 21 can be a mono- 
chrome camera. If colors are also to be measured, the 
line scan camera 21 used is a color camera. 

50 [0018] In the method of Fig. 3, the operation of the 
light sources 10-12 illuminating at different times from 
different illumination directions 13-15 and that of the line 
scan camera 21 and of the channel separator 16 are 
synchronized by pulsing by the timing controller 1 8, the 

55 pulsing frequency of the light sources 1 0-12 illuminating 
at different times being >1 kHz. An imaging period is de- 
fined in the method by the timing controller 18: during 
each imaging period, the object's surface 20 is illuminat- 
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ed once from each illumination direction used. During 
each imaging period, a light beam from each illumination 
direction 13-15 is focused on the object's surface 20, at 
least partly on the same region, by the focusing means 
22-24. In a preferred embodiment of the invention, the 
focusing means 22-24 are focusing and collimating 
lenses. When a monochrome camera is used as the line 
scan camera 21, and light sources 10-12 are pulsed 
from at least three illumination directions 1 3-15, the pre- 
ferred embodiment of the invention can also be imple- 
mented such that the light beams from the different illu- 
mination directions 13-15 obtained during the imaging 
period are focused on different regions on the object's 
surface 20. 

[0019] The pulsing frequency of the light sources 
10-12 is determined on the basis of the speed of the 
moving object under inspection, so that the object's sur- 
face 20 can be inspected thoroughly. In other words, 
during a given imaging period, a region that is adjacent 
to the region that has been illuminated and imaged dur- 
ing the preceding imaging period is illuminated and im- 
aged. The embodiment can also be implemented such 
that the surface region illuminated and imaged during 
the imaging period is not adjacent to the region illumi- 
nated and imaged during the preceding period but is 
spaced from it. The longer the distance, the larger the 
area on the object's surface 20 that will not be inspected 
at all, i.e. the quality of the whole surface will thus not 
be inspected. 

[0020] The imaging frequency fk of the line scan cam- 
era 21 is defined by the formula fk=n*fv, where n is the 
number of illumination directions and fv is the pulsing 
frequency of the light sources of individual illumination 
directions. This is apparent from Fig. 3, which shows 
that when three illumination directions 13-15 are used 
to illuminate a region on the object's surface 20 at dif- 
ferent times, the line scan camera 21 must be fast 
enough to image the object's surface region illuminated 
with at least one light source at a time from each illumi- 
nation direction, i.e. the imaging frequency of the line 
scan camera 21 must be triple the pulsing frequency of 
the light sources of individual illumination directions 
13-15 in a situation where three illumination directions 
13-15 are used to illuminate a region on the surface 20 
of the object to be imaged. 

[0021] Fig. 4 is a schematic presentation of the oper- 
ation of the line scan camera 21 . The line scan camera 
21 comprises sensors 25 for receiving beams of light 
emitted from the object's illuminated surface region. The 
arrangement comprises a timing controller 1 8 for imag- 
ing the object's surface region illuminated from each il- 
lumination direction with a line scan camera 21 as dif- 
ferent successive lines, which form the output signal of 
the camera. 

[0022] Fig. 5 shows a pulsing scheme for the light 
sources of different illumination directions 10-12, when 
the object's surface region is illuminated with light sourc- 
es of three different illumination directions 13-15. The 



light sources of the different illumination directions 
13-15 are pulsed so that the object's surface region is 
illuminated once from each illumination direction 13-15 
during the imaging period. The beam of light from the 

5 illumination direction 1 3 from which the object's surface 
region is illuminated first is imaged with the line scan 
camera 21 as linel , the beam of light from the illumina- 
tion direction 14 from which the object's surface is illu- 
minated second is imaged as Iine2, and the beam of light 

10 from the illumination direction 1 5 from which the object's 
surface is illuminated third is imaged as Iine3. The line 
scan camera 21 thus images the object's surface region 
illuminated from each illumination direction 13-15 as dif- 
ferent successive lines, which form camera lines 50 as 

15 the output signal of the line scan camera 21 . Each line 
comprises image information on the object's illuminated 
surface region. In the example, when three different il- 
lumination directions 13-15 are used, the object's illumi- 
nated surface regions are imaged in the first imaging 

20 period as linel , Iine2 and Iine3, as mentioned above. In 
the imaging periods that follow, the object's illuminated 
surface regions are correspondingly imaged as lines in 
the same order of illumination directions 13-15: in the 
second imaging period, for example, as Iine4, Iine5 and 

25 Nne6. The lines are arranged as described above, im- 
aging period by imaging period, until the last image has 
been taken. An example for this is a series of lines such 
as linel, Iine2, Iine3, Iine4, Iine5, Iine6, NneX, in 
which NneX stands for the image taken last. The series 

30 of lines is the output signal of the line scan camera 21 
and can be, for example, a video signal. 
[0023] Fig. 6 shows a channel separator 16 for per- 
forming channel separation on the output signal of the 
line scan camera 21. The channel separator 16 com- 

35 prises a multiplexer 51 for performing channel separa- 
tion on the received output signal (camera data) of the 
line scan camera21 ; a counter 52 for identifying the sep- 
arated channels CH1 , CH2, etc. correctly; and FIFO cir- 
cuits 53-55 for satisfying the FIFO principle at the output 

40 of the channel separator 1 6. The channel separator fur- 
ther comprises an interpolator 111 for producing inter- 
polated outputs CH1 *, CH2*, etc. to the image analyzer 
1 7. The interpolator 1 1 1 processes the images for each 
channel separately. The role of the interpolator 111 is to 

45 estimate the output signal for interlaced lines of a chan- 
nel such that the (estimated) interlaced lines of the proc- 
essed channel CH1 are perfectly registered with (meas- 
ured) lines of another channel CH2 and therefore form 
the basis for pixelwise combinations of the images from 

50 CH1 and CH2. The simplest embodiments do not com- 
prise the interpolator 111. The channel separator 1 6 can 
also comprise software run on a computer. 
[0024] In Fig. 6 the multiplexer 51 performs channel 
separation on the output signal (camera data) of the line 

55 scan camera 21 to separate the lines of the series as so 
many channels as there are illumination directions that 
are used to illuminate the object's surface. Per each im- 
age period, the lines that contain image information on 
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the object's surface regions illuminated from the same 
illumination direction are separated as the same chan- 
nel. In other words, in the above example where the ob- 
ject's surface regions are illuminated from three different 
illumination directions 13-15 and the illuminated surface 
regions are imaged as linel, Iine2, Iine3, Iine4, Iine5, 
Iine6, lineX, the lines of the first imaging period are 
separated as follows: linel is separated as channel 
CH1, Iine2 as CH2, and Iine3 as CH3. The counter 52 
of the channel separator 16 receives a line start com- 
mand from the timing controller 18, and on the basis of 
the command the counter 52 counts the lines to be sep- 
arated as channels so that they are identified correctly. 
In other words, on the basis of the count conducted by 
the counter 52 the lines of the second imaging period 
separate in the example as the same channels in the 
corresponding order of illumination: Iine4 separates as 
CH1 , Iine5 as CH2 and Iine6 as CH3. The channel sep- 
aration continues in the same way until the end of the 
lines of the serie. The channels are supplied to image 
analysis from the FIFO circuits 53-55 on the FIFO prin- 
ciple (first in first out), i.e. from the series of lines linel , 
Iine2, Iine3, Iine4, Iine5, Iine6, lineX, channel CH1 
separated from the first line (linel) is outputted to the 
image analysis first, channel CH2 separated from the 
second line (Iine2) is outputted to the image analysis 
second, etc. Channels CH1, CH2, etc. separated from 
the lines of the next imaging periods are outputted to the 
image analysis or optionally to the interpolation carried 
out before the image analysis in the corresponding order 
according to the FIFO principle. 

[0025] The arrangement comprises an image analyz- 
er 17 shown in Fig. 7 for performing image analysis on 
the basis of the channels obtained from the channel sep- 
arator 1 6. The image analyzer 1 7 comprises an estima- 
tor 60 for estimating the image information of the chan- 
nels on the physical properties of the object's surface 
region; a detector 61 for detecting physical flaws on the 
surface region; a feature extractor 62 for extracting the 
discriminating features of the physical flaws of the sur- 
face region; a classifier 63 for classifying the physical 
flaws (area, width, length, contrast of a defect) of the 
surface region; and a decision maker 64 for drawing the 
correct conclusions from the classified physical flaws of 
the surface. 

[0026] The method of Fig . 7 comprises the step of per- 
forming an image analysis for inspecting the object's 
surface on the basis of the information contained in the 
channel-separated channels. The image analysis com- 
prises analysis of image information on the object's illu- 
minated surface region, contained in at least two chan- 
nels. The image analysis comprises estimation of the 
image information of the channels on the physical prop- 
erties of the object's surface region. On the basis of the 
estimation, the physical flaws of the surface are detect- 
ed and classified, and the characteristics of the flaws 
are defined. On the basis of the characteristics defined, 
classification is performed, and on the basis of the clas- 



sification, conclusions are drawn on the physical flaws 
of the surface. 

[0027] The image analysis is performed by comparing 
the image information of at least two channels with each 

5 other. To allow comparison, the channels of one and the 
same imaging period contain image information on at 
least partly the same surface region of the object. The 
channel comparison may reveal one of more of the fol- 
lowing characteristics of the object's surface region: 3D 

10 profile (for example slopes), glossiness and reflectivity. 
In a preferred embodiment of the invention, the object's 
surface region can be dark-field-illuminated from at least 
two illumination directions, and optionally also bright- 
field-illuminated from at least one illumination direction. 

15 in Fig. 3, the surface of the moving object is illuminated 
from two dark field illumination directions 13-14 and one 
bright field illumination direction 15. The essential point 
in the preferred embodiment of the invention is that the 
light sources 10-12 of all the illumination directions 

20 1 3-15 are as isochromatic as possible. The light sources 
are isochromatic if their wavelength range is essentially 
the same, i.e. when at least 50%, preferably more than 
90%, of the illumination power of the light sources is 
within the same wavelength range. The changes in the 

25 color of the surface 20 do thus not distort the measure- 
ment of the characteristics of the surface region. Fig. 8 
shows how the different characteristics of the surface 
region can be calculated accurately by channel compar- 
ison. Each illumination direction used is represented by 

30 a channel, which is first high-pass-filtered. The 3D pro- 
file of the object's surface region is calculated by com- 
paring the image information of the channels of two dark 
field illumination directions 13-14 with each other so that 
one channel is subtracted from the other. The glossi- 

35 ness of the object's surface region is calculated by com- 
paring the image information of the channels of all three 
different illumination directions 1 3-1 5 with each other so 
that the channels of the dark field illumination directions 
13-14 are subtracted from the channel of the bright field 

40 illumination direction 15. The reflectivity of the object's 
surface region can be calculated by comparing the im- 
age information of the channels of all three illumination 
directions 1 3-1 5 so that all the three channels are added 
together. 

45 [0028] In a preferred embodiment of the invention, the 
image information obtained from the same illumination 
direction for example in two successive imaging periods 
are separated as the same channel. The object's sur- 
face is checked by comparing the channels for example 

50 by comparing the image information obtained from illu- 
mination direction 14 with the image information ob- 
tained from illumination directions 13 and 15. 
[0029] The arrangement comprises, for example, la- 
ser diodes and/or LEDs as the light sources 10-12 pro- 

55 viding illumination at different times. In a preferred em- 
bodiment of the invention, the use of isochromatic pulsa- 
ble light sources, such as laser diodes, and a monochro- 
matic camera as the line scan camera 21 for inspecting 
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the 3D characteristics of the surface 20 of a moving ob- 
ject eliminates the off-color problem, which renders the 
surface inspection considerably more reliable. 
[0030] The use of laser diodes as light sources 10-12 
allows better inspection of the surface 1 of a moving ob- 
ject, for example a hot moving surface, from a distance. 
The inspection from a distance here refers to inspection 
from a distance of at least one meter, but perhaps even 
of three meters. The object's movement is indicated by 
arrow A. The preferred embodiment of the invention is 
based on the idea that the beams of light emitted by the 
laser diodes are coherent, whereby the beams of light, 
i.e. the illumination, can be focused on asmall area even 
from afar. In other respects, the arrangement and meth- 
od comprise the same components and method steps 
as described above. 

[0031] To determine the colors in a preferred embod- 
iment of the invention, light sources 10-12 with a wide 
illumination spectrum, such as LEDs, or light sources 
with different illumination spectrums, i.e. of different 
colors, such as LEDs and/or laser diodes, are used in 
the illumination directions 13-15, and a color camera is 
used as the line scan camera 21. The most accurate 
color measurements are obtained with wide-spectrum 
light sources, which cover the whole wavelength range 
of visible light, 400 nm to 700 nm, as evenly as possible. 
This kind of spectrum 70 is shown in Fig. 9a. When less 
accuracy is considered sufficient, combined sources 
can be used in the color measurement, said sources be- 
ing identical in each illumination direction used. The 
combined sources have different illumination spectra, i. 
e. they are light sources of different colors. Fig. 9b 
shows, by way of example, spectra of the combined 
sources 71 of one illumination direction. The spectra of 
the lightsources in the other illumination directions used 
are identical, i.e. the light sources 1 0-1 2 are isochromat- 
ic. The light sources of different colors have essentially 
different wavelength ranges, whereby less than 50% of 
the illumination power of the light sources is within the 
same wavelength range. The wavelength range of the 
beam of light of a light source with a wide illumination 
spectrum is more than 50 nm wide. Another advantage 
brought about by the illumination of the surface regions 
from different illumination directions 13-15 at different 
times and the image analysis based on the image infor- 
mation obtained from the above illuminated surface re- 
gions by imaging in accordance with the invention is that 
no off-color problems occur, not even when combined 
sources are used in accordance with the above. Since 
the inspection of the surface allows the colors to be es- 
timated correctly, the surface's 3D analysis, glossiness 
analysis and reflectivity analysis are rendered consider- 
ably more reliable. An indication of the improved relia- 
bility is, for example, that false alarms are avoided, 
which greatly speeds up the production process. 
[0032] Plastic surfaces, for example, may differ slight- 
ly in color when they are inspected from different illumi- 
nation directions. In a preferred embodiment of the in- 



vention, the use of pulsed light sources and a color cam- 
era as the line scan camera 21 enables a separate color 
measurement to be carried out in the object's each sur- 
face region illuminated from each dark field and/or bright 

5 field illumination direction 13-15. This is sometimes im- 
portant in order to obtain sufficient information on the 
color characteristics of the surface under inspection. 
[0033] The essential point in the preferred embodi- 
ments of the invention is how the object's surface is il- 

10 luminated from different illumination directions 1 3-1 5. In 
the preferred embodiments of the invention, the illumi- 
nation characteristics can also be brought about by op- 
erations and/or equipment that do not relate to light 
sources. 

15 [0034] Fig. 10 shows a preferred embodiment of an 
arrangement and a method of the invention when the 
moving surface 20 under inspection is illuminated from 
two different illumination directions 13-14 at different 
times by dark field illumination. The object's movement 

20 is indicated by arrow A. When the object's surface re- 
gions are illuminated from two different illumination di- 
rections 13-14 at different times in accordance with the 
invention, the two images of dark-field-illuminated sur- 
face regions taken in the above situation during one im- 

25 aging period contain a sufficient amount of imaging in- 
formation for successful image analyses. In other re- 
spects the arrangement and method comprise the same 
components and method steps as described above. 
[0035] Fig. 11 shows a preferred embodiment of an 

30 arrangement for inspecting the surface 80 of a moving 
object, the arrangement comprising four line scan cam- 
eras 84 for imaging the surface regions of the moving 
object. The arrangement further comprises so many 
light sources 81 -83 in the illumination directions that the 

35 whole width of a wide area 85 to be imaged by four line 
scan cameras 28-31 can be illuminated. The orthogonal 
movement of the object to be inspected is indicated by 
arrow B. In other respects the arrangement comprises 
the same components as described above. 

40 [0036] In the preferred embodiment of the method il- 
lustrated in Fig. 1 1 , adjacent surface regions of the mov- 
ing object are imaged with four line scan cameras 84 
arranged in spatially different places. The number of the 
light sources 81-83 in the illumination directions is de- 

45 signed to be so great that the entire width of the surface 
region of the moving object can be illuminated from each 
illumination direction in turn. In other respects the meth- 
od comprises the same method steps as described 
above. 

50 [0037] The preferred embodiment of Fig. 11 can be 
applied, for example, to inspection of a hot band. The 
object to be inspected is then a hot surface, which is 
illuminated with light sources 81 -83 from the illumination 
directions and imaged with line scan cameras 84. The 

55 object's surface 80 is here inspected from a distance, 
and to guarantee sufficient illumination power, the light 
sources 81 -83 must here be laser diodes. 
[0038] When the 3D characteristics of the surface 80 
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are to be measured in a situation where the colors of the 
surface are not relevant, the preferred embodiment of 
the invention is implemented by color modulation and 
pulsing, combining the arrangements of Figs. 10 and 11 . 
In the embodiment, the object's surface is illuminated at 5 
different times from five different illumination directions 
13, 14, 81, 82, 83, which provide two opposite pairs of 
dark field illumination directions 13, 14 and 81, 82, and 
abrightfield illumination direction 83. Pulsed light sourc- 
es of the same color, for example red, illuminate from 10 
Illumination directions 1 3 and 1 4, and pulsed light sourc- 
es that are mutually of the same color, for example 
green, illuminate from illumination directions 81 and 82. 
The bright field illumination direction 83 has at least one 
pulsed light source of a third color, for example blue. The 15 
comparison of the image information of the channels ob- 
tained from the above-mentioned illumination of the ob- 
ject's surface regions enables analysis of the surface's 
3D characteristics and estimation of the surface's gloss- 
iness and color. 20 
[0039] Fig. 12 illustrates inspection of a moving sur- 
face using pulsed illumination and an area scan camera 
121. The object's movement is indicated by arrow C. 
The moving surface is imaged with an area scan camera 

121 that produces one image area typically at a frequen- 25 
cy of 50 or 60 Hz when cameras in accordance with the 
most general video standards are used; with special 
cameras the image frequencies can be faster or slower. 
The image area typically comprises hundreds of image 
lines (e.g. 250), which are illuminated simultaneously 30 
during the illumination period. Each image line compris- 
es hundreds of pixels (e.g. 750). The surface 120 is il- 
luminated evenly on the entire area to be imaged, i.e. 

the area seen by the camera 121 , from at least two di- 
rections 124, 125 with light sources 122, 123 that can 35 
be pulsed, for example with a xenon strobe or LED light 
sources. The illumination pulse must be so short that 
the object's surface 1 20 does not have time to move, for 
example, more than by the breadth of one pixel. The 
light sources 122, 123 are pulsed so that light source 40 

122 is pulsed once during the illumination period of the 
first image, and light source 123 is pulsed once during 
the illumination period of the second image, etc. in ac- 
cordance with how many illumination directions are 
used. The images obtained from the camera are sup- 45 
plied to the channel separator 1 6, which forms continu- 
ous image line channels CH1 , CH2, etc. from the imag- 
es of each illumination direction. For further processing, 

the images of the different channels are interlaced to 
find out which image lines of each channel have been 50 
imaged at the same point of the surface 1 20. This is per- 
formed by measuring the speed of the surface 120 and 
by calculating how many image lines have transferred 
between the illumination pulses. The images can also 
be registered in the channel separator 1 6 by calculating 55 
the correlation between two images in the travel direc- 
tion of the surface 120 on the basis of the image infor- 
mation. In order that the moving surface 120 could be 



inspected entirely with a single camera 1 21 , the speed 
must not exceed the length of the region of the surface 
120 seen by the camera 121 in the travel direction di- 
vided by the number of channels and the length of the 
illumination period of one image. When the speed of the 
surface 120 is higher than this, more than one camera 
is used, the cameras imaging adjacent areas in the trav- 
el direction of the object. The channel separation can 
be implemented by software using a computer provided 
with an image capturing board, the measurement of the 
surface speed using a speed encoder 1 26 and the puls- 
ing control of the light sources 122, 123 being also as- 
sociated therewith. The position registered channels ob- 
tained in the above manner are processed further in a 
similar way as the channels produced in the line scan 
camera method. 

[0040] The equipment needed for line scan camera 
21 imaging comprises imaging optics, CCD line detec- 
tors as sensors, and signal processing electronics. The 
signal processing electronics comprises timing elec- 
tronics, amplification electronics, AD conversion elec- 
tronics and outlet connection electronics. 
[0041] The timing controller 18 is implemented by 
electronics integrated into a camera interface board, 
and/or by discrete electronics. 

[0042] The image analyzer 17 is implemented as 
computer software, and by a camera interface board 
and a preprocessing board. More specifically, the oper- 
ating components of the analyzer are implemented as 
follows. The estimator 60 is implemented by a preproc- 
essing board and/or by computer software. The detector 
61 is implemented by a preprocessing board and/or by 
computer software. The feature extractor 62 is imple- 
mented by computer software, and so are the classifier 
63 and the decision maker 64. 

[0043] Although the invention is described above with 
reference to the example illustrated in the attached 
drawings, it is to be understood that the invention is not 
limited thereto but can be varied in many ways within 
the inventive idea disclosed in the attached claims. 



Claims 

1 . A method for automatic inspection of the surface of 
a moving object, the method comprising the steps 
of illuminating a region on the object's surface from 
at least two different illumination directions, in each 
of which there is at least one light source, and im- 
aging said object's illuminated surface region with 
a camera to provide image information for analysis, 
characterized in that the light sources in the differ- 
ent illumination directions are pulsed to illuminate 
the object's surface region at different times, the 
pulsing frequency being >1kHz, and that the ob- 
ject's illuminated surface region is imaged as lines 
with a line scan camera in sync with the above puls- 
ing. 
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2. A method for automatic inspection of the surface of 
a moving object, the method comprising the steps 
of illuminating a region on the object's surface from 
at least two different illumination directions, in each 
of which there is at least one light source, and im- 
aging said object's illuminated surface region with 
a camera to provide image information for analysis, 
characterized in that the light sources in the differ- 
ent illumination directions are pulsed to illuminate 
the object's surface region at different times and 
that the object's illuminated surface region is im- 
aged with a camera in sync with the above pulsing. 

3. A method as claimed in claim 1 or 2, characterized 
in that an imaging period is defined as a period dur- 
ing which the object's surface region is illuminated 
once from each illumination direction used. 

4. A method as claimed in claim 3, characterized in 
that during each imaging period a beam of light is 
directed from each illumination direction on at least 
partly the same surface region of the object. 

5. A method as claimed in claim 3, characterized in 
that during each imaging period a beam of light is 
directed from each illumination direction on a differ- 
ent surface region of the object. 

6. A method as claimed in claim 4 or 5, characterized 
in that the directing is performed using focusing and 
collimating lenses. 

7. A method as claimed in claim 2, characterized in 
that the imaging as images is performed with at 
least one camera. 

8. A method as claimed in claim 2 and 7, character- 
ized in that the at least one camera is an area scan 
camera. 

9. A method as claimed in claim 7, characterized in 
that each image comprises image information on 
the object's illuminated surface region. 

10. A method as claimed in claim 9, characterized in 
that the images form the output signal of the cam- 
era. 

11. A method as claimed in claim 1 or 2, characterized 
in that channel separation is performed on the out- 
put signal of the camera. 

12. A method as claimed in claim 11, characterized in 
that the channel separation is performed to provide 
so many channels as there are illumination direc- 
tions in use. 

13. A method as claimed in claim 2 and 12, character- 



ized in that the channel separation is performed 
such that the images that contain image information 
on the object's surface regions illuminated from the 
same illumination direction per imaging period are 
5 separated as the same channel. 

14. A method as claimed in claim 1, characterized in 
that the imaging as lines is performed with at least 
one line scan camera. 

10 

15. A method as claimed in claim 1, characterized in 
that the line scan camera images the surface re- 
gions illuminated from each illumination direction as 
different lines. 

15 

16. A method as claimed in claim 14, characterized in 
that each line comprises image information on the 
object's illuminated surface region. 

20 17. A method as claimed in claim 14, characterized in 
that the line scan camera images the object's sur- 
face region illuminated from each illumination direc- 
tion as different successive lines, which form the 
output signal of the line scan camera. 

25 

18. A method as claimed in claim 1 or 2, characterized 
in that the output signal of the camera is a video 
signal. 



30 19. A method as claimed in claim 1 and 12, character- 
ized in that the channel separation is performed 
such that the lines that contain image information 
on the object's surface regions illuminated from the 
same illumination direction per imaging period are 

35 separated as the same channel. 

20. A method as claimed in claim 13 or 19, character- 
ized in that the image analysis is performed on the 
basis of the image information contained in the 

40 channel-separated channels to inspect the object's 
surface 

21. A method as claimed in claim 20, characterized in 
that the image information of at least two channels 

45 on the object's illuminated surface region is ana- 
lyzed in the image analysis. 

22. A method as claimed in claim 21 , characterized in 
that the analysis is performed by comparing the im- 

50 age information of at least two channels with each 
other. 

23. A method as claimed in claim 22, characterized in 

that the channel comparison reveal one or more of 
55 the following characteristics of the object's surface 
region: 3D profile, glossiness and reflectivity. 

24. A method as claimed in claim 1 or 2, characterized 
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in that the object's surface region is dark-field-illu- 
minated from at least two different illumination di- 
rections. 

25. A method as claimed in claim 24, characterized in 5 
that the surface region is bright-field-illuminated 
from at least one illumination direction. 

26. A method as claimed in claim 1 or 2, characterized 

in that the light beams from the different illumination 10 
directions have essentially similar wavelength rang- 
es. 

27. A method as claimed in claim 26, characterized in 
that when the wavelength ranges are essentially 15 
similar, more than 50% of the illumination power is 
within the same wavelength range. 

28. A method as claimed in claim 27, characterized in 
that preferably more than 90% of the illumination 20 
power is within the same wavelength range. 

29. A method as claimed in claim 22, characterized in 
that the channels are high-pass-filtered. 

25 

30. A method as claimed in claims 22 and 29, charac- 
terized in that the 3D profile of the object's surface 
region can be calculated by comparing the image 
information of the channels of two dark field illumi- 
nation directions with each other so that one chan- 30 
nel is subtracted from the other. 

31. A method as claimed in claims 22 and 29, charac- 
terized in that the glossiness of the object's surface 
region can be calculated by comparing the image 35 
information of the channels of three different illumi- 
nation directions with each other so that the chan- 
nels of the dark field illumination directions are sub- 
tracted from the channel of the bright field illumina- 
tion direction. 40 

32. A method as claimed in claim 22 and 29, charac- 
terized in that the reflectivity of the object's surface 
region can be calculated by comparing the image 
information of the channels of all three illumination 45 
directions with each other so that all the three chan- 
nels are added together. 

33. A method as claimed in claim 1 9, characterized in 
that the object's surface is checked by comparing 50 
the channels using an interpolation method. 

34. A method as claimed in claim 33, characterized in 
that the output signal of the line scan camera is es- 
timated from the object's surface region from which 55 
the output signal of the line scan camera has not 
been measured. 



35. A method as claimed in claim 1 or 2, characterized 
in that the channel separation is performed using a 
channel separator, and that the light sources of the 
different illumination directions, the camera and the 
channel separator are pulsed synchronously by 
means of a timing controller. 

36. A method as claimed in claim 1, characterized in 
that the image frequency fk of the line scan camera 
is defined by the formula fk=n*fv, where n is the 
number of illumination directions and fv is the puls- 
ing frequency of the light sources of individual illu- 
mination directions. 

37. A method as claimed in claim 1 or 2, characterized 

in that the imaging is performed using at least one 
color camera. 

38. A method as claimed in claim 1 or 2, characterized 
in that the imaging is performed using at least one 
monochromatic camera. 

39. A method as claimed in claim 1 or 2, characterized 
in that the object's surface region is illuminated us- 
ing at least one laser diode as the light source. 

40. A method as claimed in claim 1 or 2, characterized 
in that the object's surface region is illuminated us- 
ing at least one LED diode as the light source. 

41. A method as claimed in claim 2, characterized in 

that the object's surface region is illuminated using 
at least one gas discharge lamp as the light source. 

42. A method as claimed in claim 1 or 2, characterized 
in that the light beams from different illumination di- 
rections have essentially different wavelength rang- 
es. 

43. A method as claimed in claim 42, characterized in 
that when the wavelength ranges are essentially dif- 
ferent, more than 50% of the illumination power is 
within a different wavelength range. 

44. A method as claimed in claim 1 or 2, characterized 
in that at least two cameras are arranged in spatially 
different places. 

45. An arrangement for inspecting the surface of a mov- 
ing object, the arrangement comprising at least two 
light sources in at least two different illumination di- 
rections, i.e. at least one light source in each illumi- 
nation direction used, for illuminating a surface re- 
gion of the object under inspection; a camera for 
imaging the object's surface region; and an image 
analyzer for analyzing the image information ac- 
quired from the object's surface by imaging, char- 
acterized in that the light sources of the arrange- 



30 



35 



9 



17 



EP 1 030 173 A1 



18 



ment are light sources that illuminate the object's 
surface at different times from different illumination 
directions, and that the arrangement comprises at 
least one line scan camera for taking images of the 
surface region, and a timing controller for synchro- 
nous pulsing of the light sources and the at least 
one line scan camera, the pulsing frequency being 
>1kHz. 

46. An arrangement for inspecting the surface of a mov- 
ing object, the arrangement comprising at least two 
light sources in at least two different illumination di- 
rections, i.e. at least one light source in each illumi- 
nation direction used, for illuminating a surface re- 
gion of the object under inspection; a camera for 
imaging the object's surface region; and an image 
analyzer for analyzing the image information ac- 
quired from the object's surface by imaging, char- 
acterized in that the light sources of the arrange- 
ment are light sources that illuminate the object's 
surface at different times from different illumination 
directions, and that the arrangement comprises at 
least one camera for taking images of the surface 
region, and atiming controller forsynchronous puls- 
ing of the light sources and the at least one camera. 

47. An arrangement as claimed in claim 45 or 46, char- 
acterized in that the arrangement comprises the 
timing controller for defining an imaging period as a 
period in which the object's surface region is illumi- 
nated once from each illumination direction used. 

48. An arrangement as claimed in claim 47, character- 
ized in that the arrangement comprises directing 
means for focusing a light beam from each illumi- 
nation direction used on at least partly the same re- 
gion on the object's surface during the imaging pe- 
riod. 

49. An arrangement as claimed in claim 47, character- 
ized in that the arrangement comprises directing 
means for focusing a light beam from each illumi- 
nation direction used on a different region on the 
object's surface during the imaging period. 

50. An arrangement as claimed in claim 48 or 49, char- 
acterized in that the directing means comprise fo- 
cusing and collimating lenses. 

51 . An arrangement as claimed in claim 46, character- 
ized in that the arrangement comprises the timing 
controller for imaging the object's surface region il- 
luminated from each illumination direction as differ- 
ent images with the camera, which form the output 
signal of the camera. 

52. An arrangement as claimed in claim 51 , character- 
ized in that the arrangement comprises a channel 



separator for performing channel separation on the 
output signal of the camera. 

53. An arrangement as claimed in claim 52, character- 
5 ized in that the arrangement comprises the channel 

separator for performing channel separation such 
that each image is separated as a channel. 

54. An arrangement as claimed in claim 53, character- 
10 ized in that the arrangement comprises the channel 

separator for performing channel separation such 
that the images that contain image information on 
the object's surface regions illuminated from the 
same illumination direction per imaging period are 
15 separated as the same channel. 

55. An arrangement as claimed in claim 45, character- 
ized in that the line scan camera comprises the tim- 
ing controller for imaging the object's surface region 

20 illuminated from each illumination direction as dif- 
ferent successive lines, which form the output sig- 
nal of the line scan camera. 

56. An arrangement as claimed in claim 55, character- 
's ized in that the arrangement comprises a channel 

separator for performing channel separation on the 
output signal of the line scan camera. 

57. An arrangement as claimed in claim 56, character- 
30 ized in that the arrangement comprises the channel 

separator for performing channel separation such 
that each line is separated as a channel. 

58. An arrangement as claimed in claim 57, character- 
's ized in that the arrangement comprises the channel 

separator for performing channel separation such 
that the lines that contain image information on the 
object's surface regions illuminated from the same 
illumination direction per imaging period are sepa- 
40 rated as the same channel. 

59. An arrangement as claimed in claim 58, character- 
ized in that the arrangement comprises an interpo- 
lator for checking the object's surface by comparing 

45 the channels. 

60. An arrangement as claimed in claim 59, character- 
ized in that the system comprises an interpolator 
for estimating the output signal of the line scan cam- 
so era from the object's surface region from which the 

output signal of the line scan camera has not been 
measured. 

61. An arrangement as claimed in claim 56, character- 
's ized in that the channel separator comprises a mul- 
tiplexer for channel separation, a counter for iden- 
tifying the separated channels, and Fl FO circuits for 
satisfying the FIFO principle at the output of the 
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channel separator. 

62. An arrangement as claimed in claim 52 or 56, char- 
acterized in that the channel separator comprises 
computer software. 5 

63. An arrangement as claimed in claim 54 or 58, char- 
acterized in that the arrangement comprises an im- 
age analyzer for performing image analysis on the 
information of at least two channel-separated chan- 10 
nels. 

64. An arrangement as claimed in claim 45 or 46, char- 
acterized in that the arrangement comprises the 
timing controller for synchronizing the light sources 15 
of the different illumination directions, the at least 
one camera, and the channel separator. 

65. An arrangement as claimed in claim 45, character- 
ized in that the arrangement comprises the timing 20 
controller for defining the imaging frequency fk of 

the line scan camera by the formula fk=n*fv, where 
n is the number of illumination directions and fv is 
the pulsing frequency of the light sources of individ- 
ual illumination directions. 25 

66. An arrangement as claimed in claim 45 or 46, char- 
acterized in that the at least one line scan camera 
of the arrangement is a monochromatic camera. 

30 

67. An arrangement as claimed in claim 45 or 46, char- 
acterized in that the at least one line scan camera 
of the arrangement is a color camera. 

68. An arrangement as claimed in claim 45 or 46, char- 35 
acterized in that the light source comprises at least 
one laser diode. 

69. An arrangement as claimed in claim 45 or 46, char- 
acterized in that the light source comprises at least 40 
one LED. 

70. An arrangement as claimed in claim 46, character- 
ized in that the light source comprises at least one 
gas discharge lamp. 45 

71 . An arrangement as claimed in claim 46, character- 
ized in that the at least one camera is an area scan 
camera. 

50 
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